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ABSTRACT 

Ultimately, scientific numerical models need quantified output uncertainties so that modeling can evolve 
to better match reality. Documenting model input uncertainties and variabilities is a necessary first 
step toward that goal. Without known input parameter uncertainties, model sensitivities arc all one can 
determine, and without code verification, output uncertainties are simply not reliable. 

The basic premise of uncertainty markup is to craft a “tolerance” and “tagging” mini-language that 
offers a natural, unobtrusive presentation and does not depend on parsing each type of input file format. 
Each file is marked up with tolerances and optionally, associated tags that serve to label the parameters 
and their uncertainties. 

The evolution of such a language, often called a Domain Specific Language or DSL, is given in [1], but 
in final form it parallels tolerances specified on an engineering drawing, e.g., 

1 + /- 0.5 
5 + /- 10% 

2 +/- lo 

where % signifies percent and o signifies order of magnitude. Tags, necessary for error propagation, can 
be added by placing a quotation-mark-delimited tag after the tolerance, e.g., 

0.7 +/- 20% ' T_ef f ective' 


In addition, tolerances might have different underlying distributions, e.g., Uniform, Normal, or Trian- 
gular, or the tolerances may merely be intervals due to lack of knowledge (uncertainty). 





iv ii icuva uata 


iv i nutivb 

02 + M <=> 20 + M 


02 + M <=> 20 + M 

1 . 000e+22 -1.50 5.950e+04 


1 . 000e+22 -1.50 5.950e+04 

teffl = 2 


teffl = 2 

expl = 0.7 


expl = 0.7 +/-0.25U 'Eta 02' 

t eff min = 1000. 


t eff min = 1000. 

t eff max =50000. 

— markup — ► 

t eff max = 50000. 

02 = 0.2 


02 = 0.2 +/-lo 'A 02+02' 

N2 = 0.2 


N2 = 0.2 +/-lo 'A 02+N2 ' 

NO = 0.2 


NO = 0.2 +/-lo 'A 02+N0 ' 

N = 1.0 


N = 1.0 +/-lo 'A 02 +N ' 

0 = 1.0 


0 = 1.0 +/-lo 'A 02+0' 





Figure 1: Sample tolerance and tagging markup[l]. 


Table 1: Laura model parameter 
uncertainties^]. 

Reaction rates ±1 order 
Vibration-dissociation 0.7 ±0.25* 
Thermal-relaxation ±10% 
Collision integrals ±30% 

* With bounded distribution to assure samples 
fall in [0, 1]. 

specifying tolerances, but it also servers as in situ documentation of model uncertainties. This toler- 
ance language comes with a utility to strip the tolerances (and tags), to provide a path to the nominal 
model parameter tile. And, as shown in [1], having the ability to quickly mark and identify model 
parameter uncertainties facilitates error propagation, which in turn yield output uncertainties. 

To get started with model parameter tolerance/uncertainty markup, roll your own tool based on the 
grammar given here, or download one from NASArb.rubyforge.org. 
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Finally, to address pragmatic considerations such as older 
models that require specific number-field formats, C-style 
format specifiers can be appended to the tolerance like so, 

1.35 +/- 10U_3.2f 

As an example of use, consider figure 1, where a chemical 
reaction input file is has been marked up to include tolerances 
and tags per table 1 . 

Not only does the technique provide a natural method of 



